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ABSTRACT 
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DESIGNING USER - COMPUTER DIALOGUES: 
BASIC PRINCIPLES AND GUIDELINES 

Li the development of computer-based assessment systems in psychology, special attention 
must be given to the design of the user - computer interface. Users differ in their ability and 
exposure to computer applications. In most assessment settings, users are clients or patients, who 
are concerned with their task perforaiance and how they are being evaluated while using the 
computer, but have limited knowledge of the computer tool. Design of the user - computer 
interface must take these factors into account 

The computer's emerging role in psychological assessment applications has been based 
primarily on the development of software programs designed to administer traditional psychological 
tests. These programs operate on commercially available hardware systems. Thus the current 
emphasis in interface design is on development of software which controls the user - computer 
dialogue rather than design of the hardware and physical issues such as keyboard layout and 
display contrast In fact, among current software development issues, the user - computer interface 
is increasingly viewed as the major determinant of the success or failui-e of a given computer 
system (Gaines & Shaw, 1986). 

In contemporary psychological assessment the issue of test equivalence has become prominent 
in the process of automating traditional psychological testing instruments. As pointed out by 
Harrell, et aL (1987) and Honaker (1987, this symposium), computerization changes one of the 
most basic technical elements of test standardization; the mode of test administration. This is most 
likely to effect the ejqjeriential equivalence of the two test forms; as the nature of item display, the 
mode of responding, and user flexibility in responding are inherently modified when computer 
interaction is required. These changes may consequently alter affective, percepnial, and attitudinal 
reactions to the test As indicated by Honaker (1987, this symposium), there has been considerable 
variation in the user-computer interface of assessment software utilized in equivalency research. In 
many cases, author-developed software has been utilized; while in some studies, commercially 
available programs have been used Thus, previous research may have inadvertently investigated a 
range of alternative forms of computer administration. 

It is widely accepted that there are a number of design criteria to be fulfilled in order to produce 
"good" user - computer dialogues (see Smith and Mosier, 1984 for a good example of criteria and ' 
guidelines for complex interface sysiems). Standards and guidelines for the design of general 
user-computer interfaces are applicable to the item presentation and response option issues 
particular to psychological test administration. In this presentation I will outline the basic principles 
of user - computer dialogue development in the area of psychologic.''^ test automation. I wiU also 
emphasize principles related to maintaining equivalence between traditional and computer test 
administration. 

The principle functional elements of user - computer dialogues include data display, data entry. 
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and sequence co. jol. Data display encompasses presentation of instructions and test items to the 
user via the computer's display screen. Data entry is concerned with input by the user of data 
items to be processed by the computer. Sequence control involves the logic and means by which 
inputs and outputs are linked to become coherent transactions, and which gpvem the transitions 
fipom one transaction to the next Within each of these elements there are specific principles and 
guidelines for design. When these are taken into consideration, the overall logic of the user - 
computer dialogue is increased, allowing the user to concentrate on the application, rather than the 
computer medium, 

DATA DISPLAY 

When the computer is utilized for test administration, the user's interaction with the computer 
begins with the screen display. The user looks to the display to provide information about how to 
take the test The content of test instructions displayed \da computer should, of course, be the same 
as those provided for in the traditional mode. 

However, in addition to those instructions, the user will need instructions regarding use of the 
computer in place of the more familiar paper and pencil. It is necessary to provide an introduction 
to the computer keyboard, and to the specific process of using the keyboard to enter information, 
change responses, and review previous responses, A good introduction will display the keyboard 
on the screen, graphically identify relevant keys, and provide example items which allow the user 
to practice use of the keyboard and receive specific feedback regarding their responses. 

Three principles underlie development of display screens for psychological testing: 

1, Display formatting should be guided by its* principle function: to display data which the user 
can easily assimilate and from which the user can quickly extract information. It is important 
tc remember that computers provide and displav data , it is the user who extracts information 
from that data . 

2, Display formatting should parallel traditional data presentation, if equivalence is of concern. 
Within that constraint, display formatting guidelines may not indicate what the specific 
contents of a display should be, but only how those contents should be presented, 

3, Data presentation should be consistent: the user should always know where to look for the 
same or similar dat?. on different screens. 

Some basic guidelines which follow from these principles: 

1, A common standard is to display only one test item and it's associated response options per 
screen 

2, If equivalence with traditional formats is desired, use a format similar to the paper-and-pencil 
one for greater equivalence 

3, Use consistent terminology : for displayed data and labels, choose words carefully and then use 
them consistendy. 
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ex. the word "screen** should not be used in one place where "display" or "monitor" is used in 
another 

4 Observe conventional use of mixed case (upperAower) 

exception: a label or tide intended to attract a user's attention might be displayed in upper case, 
or reverse video, or highlighted 

Normally, text is easier to read with conventional use of mixed case. 

5. Use affirmative wording when possible: 

ex» Answer all items before leaving this section (good) 

Do not leave this section before answering all items (bad) 
always tell the user what to do, rather than what to avoid 

6. Use Active voice rather than passive voice; it is easier to understand 
ex. Qear the screen by pressing CONTEsfUE (Active) 

The screen is cleared by pressing CONTINUE (Passive) 

7. Place tide displays at top, be concise yet descriptive 

Reserve bottom lines of display for status and eiror messages, prompts to the user 

8. Keep screens simple. Think in terms of what an individual focuses on when using a traditional 
mode of adn:unistration« 

DATA ENTRY 

The principle task for the user when completing a psychological test on the computer is to 
enter the specified data, primarily answers to questions. As noted earlier, the computer is only 
tile medium for test administration, and therefore should intrude on die user only when 
necessary to prompt the user to respond, to provide expected feedback, and to alert the user to 
errors in entries. 

A fundamental decision in interface design is the selection of the dialogue types that will be 
used to implement data entry. However, for traditional psychological testing applications, 
dialogue types may be constrained by the need for consistency with die standard administration 
mode. In most curren' psychological testing applications, the greatest percentage of screens 
display questions and response options. Multiple choice and T/F formats prevail, although 
fiU-in-tiie-blank and sentence completion are not uncommon response requirements. Form 
filling, such as typing in one's name, social security number, completing sentences, or typing in 
short paragraphs provides greater flexibility in data entry, but requires more user training and 
more extensive computer prompting. 

The primary objectives in developing data entry dialogues for psychological testing are: 

1. Minimizing the necessary input actions and memory load on die user 

2. Maintaining consistency of data entry transactions tiioughout the dialogue 

3. Allowing flexibility in user control by enabling review of entries and error correction 

4. Using an overall logic which enables the user to feel in control of die data entry 
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process, not manipulated by the computer 
Guidelines for data entry design: 

h Provide displayed feedback for all user actions during data entry, 

ex. key presses should be followed by a display of die associated symbol or an explicit 
acknowledgement of the key press via a more extensive response displayed by die computer 

2. Allow a consistent input method: the user should be able to stay with one method of data entry or 
to use consistent methods for same rypes of data* 

ex. keyboard for textual input, keypad for numerical inputs 

3. Incorporate defined display areas for data entry: clear visual definition of data entry areas or fields 
provides explicit guidance as to die location and extent of data entry. 

ex. underlined or reverse- video highlighted fields, which are replaced by data, entries; ENTER 
moves cursor to next data field 

Highlight selected data or options: when user is performing an operation on a particular display 
item or has selected a particular option, it should be highlighted 
4 Provide a clear and consistent metiiod for data review and change of entries. 

cx> use of BACK-UP key and ERASE (delete) functions which parallel familiar test-taking 
functions 

all changes should be immediately displayed to the user 

5. Require an explicit ENTER action to move to anodier stage of daia entry or to initiate processing of 
data 

processing should never be a side effect of some odier action 

6. Provide a clearly labeled ENTER key and use consistendy 

7. Provide confirmations of completed user actions: die computer should acknowledge completion of 
a data entry sequence with a confirmation message or an explicit error message 

ex. Continue to next item; The test is now completed 

8. Avoid use of abbreviations, esp. with novice users 
(reduces memory load) 

9. The computer should provide explicit prompts for data entry, such as required format, acceptable 
values, or valid options ^ 

10. Include all relevant options to users 

in some cases an open option may be needed: i.e.. Other: 

11- Use single keystroke character entry 

avoid complex keying methods such as having to press more dian one key simultaneously 
ex. avoid use of CTRL or OPTION key sequences 

12. Observe upper/lower case equivalence: for data entry other dian text, treat upper and lower case 
letters as equivalent 

13. For text ';ntry, display all entered textual material, as entered, widi fiill editing capabilities and 
cursor movement. 
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14. Automatic word- wrap at right margin 

15. Provide automatic data validation - the computer should check entries for incorrect content 
wherever specific ranges or limits exist 

ex. dates / ages / sex / T/F and multiple choice questions 
18. Qear eiror messages should be provided during data input - error messages should indicate 
appropriate entries 
ex. Acceptable responses must range from 1 to 5 
ex. Press T for true 
Press F for false 

Press Back-up to review the previous question 

SEQUENCE CONTROL 

Sequence control refers specifically to the computer logic and user actions which initiate, 
iiitemipt, and terminate the user - computer dialogue. These elements govern tiie transitions from 
one transaction to the next, and evaluate die appropriateness of user inputs. 

A critical determinant of user satisfaction and acceptance of a computer system is the degree to 
which the user feels in control If die user cannot control die direction and pace of die dialogue, 
tiien he/she is likely to feel frustration and/or intimidation. (Brown et aL, 1983). Thus, die 
software logic should anticipate every possible action by user, no matter how improbable, and 
provide an appropriate computer response to random inputs as well as correct entries and likely 
errors. In particular, a dialogue should never reach a dead end widi no further action available to 
die user. If an inappropriate ent .y is made, die computer should display an advisory message 
indicating die available response options and dieir meaning. 

Principles of sequence control in automated psychological testing applications: 

1. The computer progran?. must perform in an efficient, reliable, and predictable manner, 
surprises and dead-ends are frustrating to users 

2. The softv/are should require minimal program control actions by the user. Design the program 
to be self-explanatory in operation and do not require die user to perform any unusual 
"computer operations" in order to initiate or tenmnate die program. 

3. The internal operations of the computer should be transparent to the user, except in diose cases 
where informing die user of computer operation allows die user a greater sense of control. 

4. Users will make errors, and dialogue design must facilitate detection and correction of those 
errors. 

Guidelines: " 
1. The user should not be faced widi sequence control activities related to operation of die program 
A common example is Menu Selections, which have no analogue in traditional assessment 
formats 
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2. Function keys should be used sparingly, and should be designed to duplicate traditional 
test-taking activities such as erasing, returning to an earlier item, and continuing to the next 
item 

While these functions are necessary to simulate traditional test-taking actioi *hey require 
some training and computer prompting. 

Function keys should be labeled distinctively on keyboard, should operate witii single keying, 
and should be placed in a distinctive and convenient location on the keyboard, 

3. Keep control and function keys consistent across in form and consequence thoroughout the 
dialogue 

the terminology used in diplay/keyboard labels of functions should be consistent as well 

4. Features relevant to sequence and control should be displayed in a distinctive position and/or 
format, either bold/highlighted/5reverse videoed/ at bottom of screen 

5. Every control action by the user should result in an acknowledgement by the computer, either 
by one of die following: 

a) execution of a request 

b) a message indicating die transaction is completed or in progress 

c) a message that the control action is in error and the available options 

The absence of a computer response is not an acceptable means of indicating that a cc ;trol 
entry is being processed 

6. If a selection is made which is invalid for a particular transaction, no action should result except 
display of an advisory message indicating what selections are appropriate at that point 

- messages should indicate what is wrong and what can be done about it 
• the cursor should be repositioned to the faulty entry 

7. Permit user to return easily to previous steps in a transaction sequence in order to correct an 
error or make a change - need flexible back-up command 

8. Inform the user when all data is entered, and provide appropriate guidance for further user 
actions 

"The test is now completed and the computer is saving your answers to die questions. Thank 
you for your cooperation. Please let die examiner know diat you have finished" 

FUTURE DIRECTIONS 

The purpose of investigating and evaluating user - computer dialogues is to enhance the 
"usability" of die computer (Gould & Lewis, 1985), While diere is no comprehensive or 
generally accepted model of how to design usability into comput r systems, all a^proaches seek to 
bring die user - computer interface in line with die user's common knowledge and experience 
base. In die area of automated psychological assessment, our contemporary emphasis is on 
providing a usable interface, while maintaining consistency widi die original assessment formats, 
Hov/cvcr, our real challenge in die future is in developing new assessment procedures which take 
advantage of die strcngdis and capabilities of die computer medium, especially where we can 
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combine those canabilities with metaphors familiar to everyday experience. 

The nature of user - computer dialogues was tremendously e;q)anded by the development of the 
representational interface, as exemplified in the Macintosh computer* The representational 
interface utilizes pictographic symbols, or icons, to represent underlying functions of the 
computer. Icon design capitalizes on their infcnnation-<:anying capacity by unifying individual 
icons into a collective metaphon Thus the icons in the interface have a form which corre!TX)nds to 
actual objects in the real world, with which users are familiar* The metaphor uses the established 
attributes and associations of the real- world object?, carrying them over into the model of the 
interface presented to the user (Gittins, 1986)* For example, the computer saeen may be 
conceptualized as a desktop, with icons provided to represent ihe documents, files, mail trays, and 
rubbish bins found in the typical office- In this office metaphor interface, users can 
metaphorically "see" their actions and the consequences of those actions, using familiar cognitive 
representations* 

This enhancement of usability capitalizes on the recognition that people tend to try to leam 
about new things by making use of their previous learning experiences. New concepts are often 
thought of in terms of old, familiar concepts - at least initially, and new cognitive structures are 
often developed by metaphorically expanding old ones ( see Qrtony, 1979; Snow et al., 1980). In 
the previous example, the naive user may approach the task of understanding the computer by 
drawing upon what he/she aheady knows about an office. But there is no reason why we cannot 
develop interface metaphors based upon interpersonal situations and dilemmas, and evaluate the 
user's ability to utilize those metaphors* 

Thus, the computer medium provides us with the opporoinity to simulate the development and 
use of metaphors in the learning process, and to interact with representations of our cognitive 
stmctures* Psychological theory and methods are providing a foundation for better interface 
design; but reciprocally, interface design provides a rich and practical domain in which we can 
evaluate complex human learning and behavior. 
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NOTE 

^ The design principles and guidelines presented in this paper are not novel, nor are tiiey in any way 
die exclusive product of die author. They simply represent die audior's distillation of numerous 
and more comprehensive reports and recommendations found in the literature on interface design, 
coupled with an emphasis directed toward iheir utility and importance in automated psychological 
assessment applications. 



